Contact Interaction with Integrated Audio and Haptics
نویسندگان
چکیده
We have developed a computer interface that simultaneously renders integrated auditory and haptic stimuli with very low latency. The interface includes a three degree of freedom (DOF) Pantograph haptic device that reads position input and renders force output. We synthesize audio by convolving the force profile generated by user interaction with the impulse response of the virtual surface. Thus, both auditory and haptic modes are tightly coupled. This system should aid in evaluating efficient algorithms for integrated rendering of both sensory modes. We will demonstrate the interface during the conference.
منابع مشابه
Virtual Reality Technologies ( Visual , Haptics , and Audio ) in Large Datasets Analysis
With the latest developments in technology, several researchers have integrated other sensorymotor channels in the analysis of scientific datasets. In addition to vision, auditory feedbacks and haptic interactions have been exploited. In this chapter we study how these modalities can contribute to effective analysis processes. Based on psychophysical characteristics of humans the author argues ...
متن کاملInteractive Granular Synthesis of Haptic Contact Sounds
The goal of this project is to automatically synthesise contact sounds that can be easily added to existing and future haptic applications without the need for extensive sound design, sampling or programming. Contact sounds are caused by interactions with objects such as scraping a surface. This continuous information about the surface is much richer than simply triggering a sound sample. In th...
متن کاملAn Integrated Approach to Computer-based Musical Instrument Design
In recent years a large number of new computer-based musical instruments have been created. While a number of these have implemented a degree of non-audio feedback as a performance aid (which generally takes the form of either haptics or visuals), the majority have tended to focus specifically (and perhaps understandably) on the audio output, and have neglected other forms of feedback. This pap...
متن کاملPassive Haptics Significantly Enhances Virtual Environments
BRENT EDWARD INSKO: Passive Haptics Significantly Enhances Virtual Environments (Under the direction of Frederick P. Brooks, Jr.) One of the most disconcertingly unnatural properties of most virtual environments (VEs) is the ability of the user to pass through objects. I hypothesize that passive haptics, augmenting a high-fidelity visual virtual environment with low-fidelity physical objects, w...
متن کاملTelepresence with no Strings Attached: An Architecture for a Shared Reality Environment
The Shared Reality Environment is an ongoing project that explores the use of virtual reality technologies to achieve realistic computer-mediated human-human interaction. The project integrates immersive displays, spatialized audio, haptics, and gesture recognition, through a minimal latency network architecture. As our primary goal is to provide distributed participants with a convincing sense...
متن کامل